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ABSTBACT 

Beports on a project in the tri-county aetropolitan 
Portland, Oregon area designed to help educators answer the 
questions: **Nhat is to be learned?" "How is it to be learned?" and 
"Bas it actually been learned?" Educational goals were produced for 
use in aanageaent and planning, and coded for retrieval froa a 
coapnter storage systea. The goal collections were designed for the 
following uses: (1) participation of students, parents, teachers, 
school boards, and local citizens in decisions about what the school 
should teach, (2) individualization of instruction, (3) 
cross-disciplinary education, (4) accountability, (5) long-range 
planning and systeaatic control of educational developaent, and <6| 
effective teacher evaluation. Types of goals, codes, and related 
support systeas used in the systea are described. Two lines of future 
development were planned based on the initial work of the project. 
The first is curriculua iaproveaent, and the second ic{ in aeasureaent 
and evaluation for which the principal product sought is a criterion 
referenced set of test iteas related to each course goal. 
CAnthor/fiC) 
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ABOUT THIS REPORT 



Walter Hatiiaway 



In recent years there has been a tremendous up- 
surge of interest in the need for and development of 
educational goals and objectives. The range of in- 
terest has run the gamut from large scale national 
efforts, to the establishment of objectives banks, to 
the development of locally designed and tailor made 
systems. This report tells what has been accom- 
plished at the local level through the cooperative 
efforts of 40 school districts in the tri-county area 
of metropolitan Portland, Oregon. The authors of 
this report have engineered a system for offering 
alternative answers to the questions, "Where to 
lead?", "How to lead?", and "Are we getting 
there?" This report reveals the complexity and the 
promise of a system designed to help educators 
communicata to one another the best answers they 
can find to those questions. 

Victor W. Doherty is A^istant Superintendent 
of Evaluation in the Portland Public Schools. He has 
had experience e&a teacher, principal and since 1950 
been engaged in research and evaluation at Ohio 
State University, Cincinnati Public Schools and 
Portland, Walter E. Hathaway is an Evaluation 
Design Specialist in the Portland Public Schools. 
He has had experienrte in teaching, information 
system design and in research and evaluation at the 
University of Pennsylvania and for the Philadelphia 
Public Schools before moving to Ore^n. 
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Victor W. Doherty & Walter E. Hathaway 

This is a report of a proj^t in the tri-county 
metropolitan Portland, Oregon area designed to help 
educators answer the questions: "What is to be 
learned?," "How is it to be learned?," and "Has it 
actually been learned?" This project has as its first 
task the production of educational goals (learning 
outcomes) appropriate for use in management and 
planning at all school system levels, and the coding 
of these goals to make their curricuiar uses apparent 
and to permit their flexible retrieval from a com- 
puter stora^ system. Its long-ran^ goal is to bring 
(insistency to the way school districts develop goal 
structures for instructional planning and evaluation 
at ait levels. Thus, while the project is initially 
occupied with producing and coding goals (over 
12,(XX) ha\^ been product and coded to date), it 
is also concerned in the long run with alternative 
ways they may be attatr^ and nr^easured. An over- 
view of the project's goals and progre^ is provided 
in Figure 1. 
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FigiMfe 1 - Status of Prefect Goals 



These goats and thi» ways they are bemg mei will be discussed 
in detail after a bnvi tHView of the project rationale. 

NEEDS TO WHICH THE PROJECT IS RESPONDING 

The goal collections are being desiyied for the following 
uses: 

1. Participation of students, parents, teachers, school 
boards, and local communitv Citieens in decisions 
i^out what the schools should teach. 

2. individualization of instruction. 

3. Cross-disciplinary education. 

4. Accountability. 

5. Long-ran^ planning and systematic control of educa- 
tional development. 

6. Effective teacher evaluation. 

PARTICIPATION OF STUDENTS, PARENTS, 
TEACHERS SCHOOL BOARDS, AND 
LOCAL COA^UNtTY CITIZENS IN 
DECISION;. ABOUT WHAT THE 
SCHOOLS SHOULD TEACH 

By providing a broad based set of alternatives for 
erating goal statements appropriate and useful at various 
levels of management and participation, the Project pro- 
vides an important resource for improving the quality ^d 
extent of participation of students, parents, tecK^ers, 
school boards, and other citizens in deciding the mission of 
the schools. An intensive look at the roles of each partic- 
ipating group in generating, reviewing, contributing to, and 
approving goals will be a future part of the effort. 

INDIVIDUALIZATION OF INSTRUCTION 

Diagnosing and meeting individual learning needs is a 
long-standing interest of educators, but one that has been 
frustrated by the apparent organizational and economic 
constraints under which schools operate. With the advent of 
the computer and the development of teaching systems and 
pro-ams based on behavioral principles, new hope has risen 
for individualization of instruction. An unfortunate aspect 
of these developments has been the questionable motiva- 
tional qualities of mechanistic teaching systems and the 
student/machine relationship on whidi they depend. A 
more fortunate by-product of the movenoent ha* been the 
attention given to defining instructional outcomes. 

The Tri-county Project is prCKiucing a type of goal that 
is suitable for instructional planning, but not constrained by 
the behavioral objectives format, in order to provide teachers 
arhd students explicit statements of possible learnings for 
wfiich they can accept accountability. The teacher and 
stuctent are free to select methods of achieving those out- 
comes that within the constraints of their resources and 
capabilities seem most promising. This provides a more 
flexible af^oach to teaching and learning than teeing 
machines and other teaching systems permit. It places 
greater demands on the ingenuity and professionalism of 
teachers but has far greater potential because of its con- 
sistency with motivational principles. 



CROSS-4}ISCIPLINARY EDUCATION 

Probably no concept is currently more abused than 
"interdisciplinary education." While the goals of subject 
matter learning are at least implicit in the textbooks md 
other materials u^ by teachers, the goals of interdis- 
ciplinary education do not have even that questionable 
point of tangible reference. The Tri-county Project, by 
developing extensive coding and retrieval systems, permits 
selection of ^Is in terms of various combinations of sub- 
h?ct matter, educational level, types of knowledge and 
pro<^, career education program goals, concepts and 
values, and index words. This system f^ovides important 
cues to interdiscifMinary planning. The goats being i^oduc^, 
althou^ they are printed in subject-oriented collections 
such as science, social sciem^, mathematics, music, etc., may 
be related and ^ouped in and across subjects through com- 
puter retrieval by requesting those goats bearing one or 
more of the seven code parameters. Thus, for example, a 
teacher interested in a unit on marine biology is able to 
request goals from these files dealing with related corxiepts 
in science, social science, lariguage, mathematics, or any 
other subject field. A detailed discussion of the seven aiding 
systems is providt J in the section on codes. 

ACCOUNTABILIT%' 

Perhaps the neatest need addressed by the Project is fo" 
a sound basis for accountability in education. Account- 
ability has been much misrepresented as a simple, linear 
relationship t^tween the vwrker and his supervisor. Educa- 
tional accountability is especially complex because it is 
impinged upon by so many levels of organization and sup- 
port. It has horizontal elements of mana^Knent, support 
and instruction, and vertical elements of federal, state, inter- 
mediate, local, and sdhoo^ organization. The aspects of 
acccHJntability that are tt>e concern of this Project are ex- 
clusively the horizontal element of instruction and the 
vertical elements of local school systems and schools. It is 
the assumption of the Project that these elements of 
accountability, though they may operate within state and 
occasionally federal guidelines, must find their first explicit 
exr^ession at the sdiool system level arnJ must undergo 
ctefinition at the pro-am (science, social science, etc.), 
OHirse {biology, boc^keeping, or a mini-course), and class- 
room or teadter level. The system of definitions and ex- 
amples that illustrate this are presented later. 

LONG-RANGE PLANNING AND SYSTEMATIC 
CONTROL Of EDUCATIONAL DEVELOPMENT 

The past few years in education have demonstrated that 
few results of experimentation and development are trans- 
portable. The inability of educators to define clear, unam- 
bi^ous statements of desired learning outcomes is an im- 
portant underlying cause, ihe Tri-county Project is estab- 
lishing sets of g<^ls that may be used consistently for 
instructional planning and evaluation. The sets ^e open 
and are added to each time teachers or curriculum planrws 
specify appropriate learning not represented in the original 
collections. However, any statement admitted to the col- 
lections unda^goes a ri^ous process of statement, defini- 
tion, and coding to insure that Its utility to teadiers is 
equal to goals already in the collection. 

The project in its philosophy distin^ishes between policy 
and the resources for the execution of policy. Classroom 
and curriculum planning has gone on, is going on, and will 
go on. Decisions are made at varicHJS levels which affent how 
this planning occurs and the directions it takes. The a>urse 
goal collections are a passive, nonprescriptive resource avail- 
able for planners who wish to execute their policies more 
efficiently and effectively. Aorordingly, methc^ological and 



pr€x:edural biases have been eliminated where possible in 
favor of a brocKi ran^ of alternatives frcMD amoftg which 
any planner should be able to ^iect iii carrying out his 
responsibilities. 

These collections will support iril currtculum development 
activities in the Portland School System within a year or 
two, and in many other school districts in the trt-county 
area as welt. The stability this will provkte educational 
experimentation and development is apparent. The power 
of the goal collections themselves in promoting good educa* 
tionai plannlnq and the e^ arKl convenience it affords 
teachers in that planning is equally evident. 

EFFECTIVE TEACHER EVALUATION 

Absence of well-stated instructional goals has been a 
chief deterrent to valid teacher evaluation. The goal collec- 
t'ons of the Tri-county Project offer teadiers extensive sets 
of well-stated outcomes upon whidi to draw in negotiating 
the parameters of their courses with those to whom they 
are responsible. Instruments for process ar^i product evalua- 
tion of teaching are being related to these course goals to 
aid in assessing their attainment. Furthermore, it goals are 
not met "because of lack of support in the form of super- 
vision, instructional materials, facilities, or any other reason, 
a basis exists for the teacher in turn to evaluate ^pport 
services. 



LANGUAGE 

K. The stiKic^nt knoM that an exclamation pomt makes an 
emphatic interjection arid a convna a mild interiection. 

Ps The stix^t IS abfe to uwb intersections ^proiKiately in 
sentences. 

K. The student knows tt^ purpose served by words In language - 
the need for comfentk>ns tf^t have the same meaning for 
those expressing as f(^ those receiving thoi^ts. 

P. The student is Me to determine a writer's qualifications, 
sources of information, and use of s^^ating phrases <"t 
believe.*./' "In my opinion...") in distin^ishing fact from 
opinion. 

K. The student knows that tfie meter signature designates tfie 
organization of meter within the bar lines. 

P. The student is able to rmd and interfxet any meter signature. 



K. The student kncHMS ttie Gonventiof>al ways music is rvthmically 
rttf^^sented in notation le.g., acxents, main b^ts, b^ lines* 
sui>-oivi«om of b^ts, time signature, notes and rests^ tiest. 



DESIGN OF THE PROJECT AND PRODUCTS TO DATE 

in the following section are rev tewed the types of goals, 
codes, and related support systems being produced by the 
Tri-county Project xo meet the needs identifi d in the 
previous section. 

THE COURSE GOALS AS THEY LOOK NOW 

Goals produced in the ei^t subject areas (art, music, 
social science, mathematics, science, health, physical educa- 
tion, and language arts) are printed or in the process of 
being printed in volumes that contain an introduction, a set 
of subject area program goals, a taxonomy of the subject 
field, and a set of detailed ''ctHjrse level" goals organized 
according to the subject matter taxonomy. 

Examples are presented below for three of the eight 
subject areas to illustrate the nature of the course goals. The 
knowledge (K) and process (P) categories illustrated telow 
are the designations used to distinguish the two basic types 
of goals in the collecttons, but 12 knowledge and 79 process 
sub-cate^ries are actually used to code the goals in the 
collections (see Tables A & B). Each of the 12,0(K)^is is 
retrievable by these sub-categories as well as by the other 
forms of coding previously mentioned and further described 
later. 

SCIENCE 

K. The student knows the functions of the cell wall, call men^ 
bf ane, cytoplasm, and nacleus of a ^tl. 

The student is able to make Met mount slides of thin sections 
of living matter. 



K. The student knows the two maior ctassificattons of trees 
defined as deciduous and rantferous and the principal char- 
actenstKrs by which they afe distin^ished. 



The ftudent is stk^ to distinguish between deckiuous oiui 
coniferous trees. 



P. The stuctent is able to image a ry thm^ pattern and encocte it 
tn notation* 

CONTENT AND FORM OF THE GOALS 

Levels of Gerar^ity Chosw for Devdi^Mnent Types of 
educational goals hava been arbitrarily designated as system, 
fKogram, course^ and instructional. Fi^re 2 illustrates all 
fcHjr levels and adds behavioral and performance objectives 
to show how they differ from the goals as defined in the 
Project. 



System Goal 



Pro-am Coat 



Course Goal 



Instructional 
Goal 



The student ts able to communicate witT 
' others^ both orally and in wvrltina in a 
manner that satisnes his need tor expression 
and the requkaments of thosa under whom 
he may become employ^ or receive funher 
education. 

P. The student Is able correctly to apjyly the 
conventions of English grammar and usage 
in sf^king afKl writing. 

K. The student knows that special verb forms 
exist for use with sin^lar and plural subjects* 

P. Tfr>e student Is able to use appropriate sin-* 
guiar and plural verkn with singular and 
plural subj^tSb 

K. The student knows the singular and plural 
forms of the verb "to be" for present and 



past tenses: 

S P 
t am We are 
You are You are 



t was 
You v^e 



P 

We were 
You were 



Hfl. sh« is They are He. she was They were 

P. The student is able to use ^propria te ^r%* 
guf£r and plural forms (present and past 
tense) of the verb "to fc>e" with sifigular and 
plural sublets in writing sentervces. 



Behaviof A» Ot>|t*c- Givmi 20 MHiton^ev. ten with ptura* «ub|et:ts 

tiv« (S|>et ifkatton dmi ten with %irt|^|ar %ufi(ect&, the student 

o1 Methoci of will Nfefiitfy th* correct number lorni of the 

Me^reinentr v<,rtHt%. arel. 

Performance Obfec^ Given 20 lentences, ten wvith plural sufoiects 

tfve < Specif katton anti ten with ^ingui^ st^btects, the stuc^t 

of Prereguiiites aml^ wHt KSentify the correct number form of the 

or Profici«ncy Level) jj^fb <is, are) with at tea«t 90*.. a* cut at y 

Fi^re 2 

In producing comprehensive sets of programs and course 
goals in eight basic K-1 2 subject matter areas, the Tri-county 
Project IS extending and retining a course already charted by 
the wvork of Tyler. Goodtad, Bloom, Walbesser, Ma^r, and 
others. In the next section the coding systems developed to 
make these collections of maximum use to clients with 
widely divergent curricular orientations are examined. In 
this still incompletely charted area lie the chief innovative 
contributions of the Prc^t. 

THE CODING OF THE GOALS 

As mentioned earfier. seven coding systems have been 
developed and applted to each of the course goals. The 
names of these codes are given in Ft^re 3. 

The codes serve two purposes. First, they make it possible 
to retrieve subsets of ^Is to user ^>ecif ication. For instant, 
a subset can be retrieved containing the primary (or any 
other level) level reading (or any other subject matter sub- 
division) ^Is which deal with the process of deoxling {or 
any other process or knowledge category). Or, a ^teet can 
be ^nerated containing all the goafs in all eij^t collections 
(or only some of them) which deal with the concept of 
"adaptation*' {or any other concept or value coded) at a 
level appropriate for hi^ school students {or any other 
instructional level). 

Secondly, the codes help the user understand the curric- 
ular dimensions of a ^1 he retrieves - the concepts and 
values it reinforces, the type of knowledge or process it 
represents, and the lar^r ^als {including career education 
goals) to which it relatos. 



Within 


1. Sub^t matter 


Discipline 


2. Instructional level 


Codes 


^ 3. Program goals 


Across 


4. Knowledge-process goal types 


Discipline 


5. Career education cpals 


Codes 


6. Values-concepts 




7. index {key words) 



Fi^ire 3 - Course Goaf Coded Relattomhips 
CODES FOR WITHIN-DiSCiPLiNE RELATiONSHiPS 



Three types of coding were designed fo*^ retrieval of goals 
within subject areas in ways that are useful for instructional 
planning. These are subject-matter taxonomy codes, instruc- 
tional level codes, and codes for the broad program ^Is of 
the subject disciplines in question. 

Subieet matter taxonomiM. The taxonomies of the ei#)t 
object areas were first written by curriculum experts ^ a 
framework for Riding teachers in writing goals. aiKl were 
revised by the teachers ^ they product the goals. By 
looking through the taxonomy at the front of one of the 
eight printed goal collections, a user c^^n find v\^at topics 
are covered arid turn to the topic in which he is interested. 
4 ^ Also, the taxonomy heading may be used along with one or 
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moreot the other codes to retrieve subsets of goals from tfie 
computerized system. 

Insmictional level* The levels diosen for coding were 
primary {P). intermediate {f), uppa^ {U). and hi^r (H). 
The level code provides the leacher or curriculum planner 
the best estimate of ttue writers as to the level or levels at 
which the learnir>g is appropriate. Many times the nature of 
the goal suggests continued learning over several levels, in 
which case all those levels are coded. These level indications 
are su^^tive only, as it is evident that the appropriate 
tinoe for learning varies with the interests and abiltttes of 
students. 

Pro-am level goal. A final code aimed at within- 
disciplinary relationships is the subject matter proyam goal. 
Recall that this more general type of goal has been written 
in each of the object areas along with the more specific and 
numerous course goals. The code numbers of any related 
(M-ogram ^1 are minen beside eadi course goal to show 
the broacter implkations of the goal and to permit the 
retrieval of any or all ccxirse goals that contribute to a given 
program goal. 



CODES FOR ACROSS-DISCiPLINE RELATIONSHIPS 

Five additional coctes were designed for retrieval of goals 
for interdisciplinary {banning. They are: knowledge-process 
goal codes; other related taxonomy codes; career education 
goai ^odes; value-c<HK^pt codes; a.t.l index word codes. 

Goal types - knowledge arV rrrcess* All goals we e 
rou^iy dassif ied as knowledge i - . depending upon 
whether they deal with s(Hnethir>4» ?^^t is to be known or 
something the student is able to / All goals, therefore, 
begin with the words, "Tht studfe .v knows..." or "The 
student is able to../' 

The familiar knowled^/pro<^ distinction is subdivided 
into twelve knowled^ and five basic process categories: 
communication processes, inquiry-problem solving fvocesses^ 
fKoductton processes, service processes, and human relations 
processes. To date the only process category that has under- 
gone substantial elaboraticM^ is the inquiry-problem solving 
cate^>ry in which over seventy sub-elements have been 
kientffied. 

The knowledge and irniuiry-problem solving pro<^s cat- 
egories are represented in Tables A and B following. It will 
be noted that these deifications owe a partial debt to 
earlier researchers; notably, Benjamin Bloom, David 
Krathwohl, Robert Gl^r, Henry Walbesser, and Ralph 
Tyler in Education; Robert Gagne and Robert Miller in 
fHychology; Jean Piaget arul Jerome Stunner in Child 
Develt^nrrent ; and others. Major differences appear, however, 
in the manner in which the categories are organized and in 
their a>ntent. This is in larc^ part due to vacation and 
revisions from applying <HJr original a priori eateries to 
12,000 goals from a variety of are^. Notice, for example, 
that the knowledge categories do not deal with knowledge 
of ger>eralizations as a basic category, but rather assume 
that any ^al representing a ^neralization must also deal 
with of^ or more of ttw basic categorizations. Generaliza- 
tions as a class of knowledge are therefore given super- 
ordinate status arxJ dividai into two classes: principles and 
laws, and simple ^rwaiizations. Also notice there is no 
eatery of knowled^ of st^cific facts as found in Blocm 
for we have been able to subsume alt such goals ufKler the 
bask: ten categories. New categories not fcnind in Bloom 
include knowledge of properties, parts, characteristics, fea- 
tures, elements, dimensions; knowledge of contexts, loca- 
tions, orientations; knowledge of operations, methods 



A - Knowtedge Cafsgortes 



G1 Pr inclines and Laws 

K1 Conventions: Names and Nomenclature 

K2 Conventions: Symliols* Rules, Standardized Precedes, 
Definitions 

K3 Properties, Parts, Characteristics^ Features, Elements, 
OimensfCHis 

K4 Trends and Sequences 

K5 Smiiarities &^ Oifferentts* Discriminations, Qassi- 
fi'.jtions 

K6 C-ntexts, Locations and Orientations 

K7 Operatioi^, Methods of Dealing with. Functions 

K8 Cau.e and Effect Relationships (Costs and Benefits) 

K9 Criteria or Stamiards 

K10 Non Cause-Effect Relationships 



PI 



TMHe B -* Imiuiry-Pr<rirfem Solving Processes 

Input Acquiring Information 



P1 1 Viewing 

PI 2 Hearing 

P13 Feeling itactlle) 

P14 Smelling 

Pib Tasting 

PI 6 Using sense extenders 



P2 



input 

Verification 



insuring Validity and Adequacy 

P21 Evaluating authorita- 
tiveness of sources 

P22 Evaluating logical consis- 
tency and accuracy 

P23 Evaluating relevance to 
desired learning purposes 

P24 Evaluating adequacy for 
acting or deciding 
(comprehensivef^s ar>d 
depth) 



functi(Kis; knowted^ of causes and effects including costs 
afui benefits, advantages and disadvantages; and knowled^ 
of relationships that are not cause-effect. 

Perhaps the most significant departures from Bloom 
concern the process categories umler problem solving and 
inquiry. First, the entire taxonomy is intended to represent 
standardized or conventional processes of problem solving 
and inquiry that can be taught and teamed rather than 
psychoiogica) processes as is the case in Bloom's handbook 
0 1 the cognitive domain. This difference is of utmost impor- 
tance to teachers who have found it difficult to deal with 
leafning goals within the context of Bioom's taxonomy, 
t^ause It was not clear how these descriptors of psychoiog- 
O cal processes could be treated instructionaliy. 
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P3 Preprocessing Organizing information 

P31 Labeling, naming, numt)er- 

sng^ coding 
P32 Recording, listing 
P33 Classifying, cat^nizing, 

grouping, selecting accord-^ 

tng to criteria 
P34 Ordering^ sequmxring 
P3S Manipulating^ arranging, 

transforming, ^>mputing 
P36 Estimating 
P37 Summarizing, abstracting 



P4 



Processing I 



tnterpreting Information (draw- 
ing meaning from data) 



P5 



Processing II 



P6 



Output I 



P41 



P42 

P43 
P44 

P45 

P46 
P47 

P48 



Decodirvg verfoai and non- 
verbal symbols (re«jing and 
literal translatir^g) 
Inferring, interpolating, 
extrapolating 
Analysing 

Associating, relating, 
eqisating 

CkKnparir^ contrasting, 

discriminatifig 

Synthesizing 

Testing against stdf>ddrds or 

criteria 

Generalizing 



Using Information to Produi^ 
New Information 

P51 Theorizing, predicting 

PS2 Formulating hypotheses 

P53 Testing hypottiem 

PS4 Revising hypotheses 



Acting on the Basis of Informa- 
tion 



P61 
P62 
P63 
P64 

P65 

P86 



P67 



Reacting 
Making decisions 
Solving problems 
Restructuring values 
(adaptif^ mcxiifying) 
Restructuring behavior 
{adapting, modifying) 
Encoding verbal and non- 
verbal symbols prior to 
communication 
Creating on the basis of 
knowled^ and proc^ 



At this point the reader may questioft the reason for the 
rather detailed and elabmate system of classifying educa- 
tional outcomes that has evolved during the Project. We 
have found that providing teachers with these classification 
systems has resulted in a more critical ai^roach to the 
writing of educational outcomes. Having written a goal, a 
teacher in attempting to place it in its appropriate category 
may find that its intent is clearly related to one of the 
categories but its form of expression does n^t immediately 
identify it with that category. By rewording the goal, the 
teadier tarings the true intent of the goal into sharper foais, 
and in almost every instance improves its meaning and 
darity. 

Also, the value of detailed classifying of knowledge and 
(M-oc^ss goals provides insist into teaching, meaMjrement, 
ar«l evaluation requirements. Work has already begun in 
analyzing types of measurement appropriate for each type 
of knowledge ^1, as described later in this article This 
work will be extendi to proc^ learning as rapidly as 
resource permit. 

Other related Gon^t taxommy l^in^ This coding is 
provided to rfiow that goals are often n^tly classified under 
more than one cate^Ky of subject matter. For example, a 
course ^1 coded under economics may be relevant to some 
aspect of history. This information is provided by coding the 
economics goal with the lelevant taxonomy number in 
history. For purposes of computer retrieval, it is possible to 
r^^uest all ^Is which deal with a particular content 
taxonomy heading, and to extract not only the goals placed 
under that he^irrg, but also all other ^Is cross-referenced 
to it wherever they are located in the collection. While this 
cap^ility presently exists CKily within a subject field, it 
later will be provicted among subject fields. 



Career ach^ation pn^mt go^s. Course goals in all eight 
object arem were coded to a set of career education program 
goals. Career education, as envisioned by the coders, con- 
cerns the total life of an individual, including day-to-day 
living, vocation, avocation, and leisure. 

It was realized by the orders that not all ^!s have h^ a 
direct retaticKiship to career education. However, any goal 
that contributes to the perswai and social oualities believed 
important to any individual in a career were coded to career 
education gc^ls that define these qualities. All skills having 
direct vocational values were, of course, coded to their 
related career education goals. This coding is the first of^ra- 
tional resource for the realization of the goat of "integrating 
career education and the rest of the curriculum." 
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Communicating information 
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P73 
P74 
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P79 



Vocalizing (non-^verbal) 

Gesturing, moving 

Touching 

Speaking 

Writing 

Using art media Ipainting, 

drawing, sculpting, 

constr.icting, etc) 

Dramatizing 

Singing, playing 

instruments 

Dancing 



CofiMptt and virfu^ Another index hi^ly useful for 
those seeking teaching strategies which cut across subject 
matter lines is the coding to concepts and values. Words 
chosen to characterize values and concepts represent resid- 
uals of exj»rierM» i lat influence the way individuals per- 
ceive and behave. Thus, the word freedom connotes certain 
behaviors associated with the ideal state. Likewise, b word 
like honesty characterizes a set of t^haviors whidi viewed 
from a societal perfj^ctive characterize an individual as 
"hcwiest". From an educator's point of view, the only re- 
sources available to help stuctents acquire the desired con- 
cepts and t^h^iora! tenctencies are the knowledge and 
proce^ learning of the experiences planned for and with 
students. 

Especially import^it in considering the nature of values 
is the distinction between the process of forming values and 
values as end products. The oirricuiar and methodological 
implications of teaching toward values as end products 



dnculcatfon of values) are entirely different from tfiose 
concerned with decision making and value formation. Wtiere 
the concern is with teachirtq how to make value judgn^nts, 
the learnings sought are pure process and have nothing to do 
with the nature of values being acquired. 

In helping students acquire values, the pedago^e must 
rely upon teaching knowledge and skills that have a logical 
bearing upon these values. Where he is concerned with the 
teaching of valuing processes, he must teach such convene- 
tioruit skills as verifying nformation. relating information to 
criteria, and methods of clarifying personal and social values 
by which the interpretation and internalization of informa* 
tion can he accomplished. These processes can be tau^t 
withm a wide ra-^qe of subtect matter. 

The distinction between these two ways of viewing and 
dealing with values is extremely important from a curricular 
and instructional point of view. It seems preierable to some 
to deal with value formation as proc^ learning rather than 
value learning, leaving free and clear the issue of wt^ether or 
not values should be taught in the public f .*ho<^s ^d what 
ttiese values should be. The value coding system used in 
these ^ai collections makes possible both ways of dealing 
with values. 

The definitions and distinctions regarding concepts and 
values 'iu%t piesented are important to an understafKiir^g of 
the way these nnatters have been approached in defining, 
classifying/and coding goals in the Tri-county Project. For 
storage and retrieval purposes, concept words have been 
treatiHi in the same w^y as end-product value words. Ttiey 
have both been listed and each of the 12,000 goals has t^n 
coded to indicate which, if any, are ontributed to by the 
learning in question. 

index words. Otfter useful tools in interdisiplinary 
planning are the index words. Alttiou^ they do not af^ar 
on the printed pa^, they are keyed to each goat for retrieval 
in much the way documents are reprieved from the familiar 
ERIC retrieval system. Users will have available lists of index 
words by discipline and ^ross disciplirves. 

Logics subHinits of goals. Finally, in the printed edition 
of tt)e couri»e goals, sets of goals which are logically related 
have this indicated by toeing included inside a bracket at the 
left margin. This alerts the user to possible sets ami sequent 
of goats which it may be desirable to use as a unit. 

PARTICiPATfON IN THE PROJECT 

More than 40 local school districts in the tri-cminty area 
of metropolitan Portland are active in the Project. This has 
been achieved through the leadership of the intermediate 
education districts of the three a>unties. 



The l>ase of participation strengthens the Project in a 
mjmt)er of ways. First, it provides greater financial and 
personnel supoort than the Portland District alone could 
provide. In organising qoai development committees it is 
possible to draw upon the onisiderabte pool of teadier 
talent in the three county area. 

School districts contribute service of teachers to goal 
development workshops, using local curriculum development 
fuiKls. Other sources of support are the State Board of 
Education, the Small Grants Program of the Regional Office 
of the U S. Office of Education, and curriculum and evdlua** 
tion funds of the Multnomah, Clackamas, and WashirgtcKi 
County Intermediate Education Districts and the Portland 
Public Schools. 



The contributicNis of the State Dep^ment of Educaticm 
atKi USOE are small in terms of the total budget of the 
f^cHect, but tt^ invoiven^t is significant. Becmne the 
Project's ^>ais are ccmsistent with the State's interests in 
bexxef educational mana^n^t practices and instructtot^l 
tmfN-ovement, it may ^entuafly be t^en over by the State 
for continuous m^ii^^nent. The involwment of the State 
has already proved impc^t^t in the dissemination of pro- 
ckicts, aiKi the Project has had an tnflwnoe on state ctevelop* 
ments in PPBS and educational goals at tt^ legislative ami 
state board level. 

USOE involvement, alttuHigh not yielding immediate 
benefits, provides future potentials for dissemination and 
involvement in the norttmest region. 

The secoTKl major value of the tri-county coaliti<m is tt)e 
testing ^^ound it ;»-ovkies for the ttteories and imxfofcts of 
the Project. In less than two years ttiere have already been 
substantial payoffs. 

Reports from the tri-county area imiicate that the col- 
lections have been used extensively in cuniculum develop- 
ment tfie p. * ear and summer. The power and versatility 
of these r ons are just beginning to be tapped. 



FUTURE DEVELOPMENTS 

Two lines of future development are planned bmed on 
the initial w jrk of the Project. The first of these is in cur- 
riculum improvetmnt and the seMfKi in n^asuretmnt and 
evaluatton^ 

llie Tri-C(Hinty Course Goal Prefect is iookirrg beyond 
its immediate job of producing goats to the currioitar uses 
of ttie^ goals. It is for this reason that the goals heve been 
deified and OKted so that the relatiomhipf referred to 
earlier can be seen more clearly t>y teachers and curriculum 
ctevelopers. 

CURRICULUM IMPROVEMENT 

The goal developntent work being done, OHjpled with the 
completion of a multi-faceted and versatile retrieval system 
will make it possible to move r^^dly ahead into f<mm of 
curriculum planning that have heretofCKe been virtually 
unmanageable, particularly interdisciplinary planning. 

The Project at this point has provided a first cut at 
defining f^-c^ess, knowted^, and value goals whidh can be 
flexibly retrieved to serve the needs of this type of planning. 
The ixoject staff now ifitends to {1 ) continue refinenr^t and 
envelopment of the conceptual elentents of the coding and 
classification systems described above. (2) define and prch- 
dui^ a more extensive set of pro<^ goals to strengtf^ the 
options for process teeing available to tead^ers^ asHi (3) 
develop guides and inservi^ strategies that will le^ to the 
fullest po^tbie use of this new curriculum planning .esource. 

MEASUREMENT 

This report will condude with a final note on the 
measurement work in proj^e^ and planned for the future. 
The prindpat product sou^t is a criterion referenced set of 
test items related to each cour^ go^. This set is to t>e so 
comprehensive that any tether who selects a course goal 
and translates it into one or more instrucnionat goals wilt be 
able to retrieve items, or at least examples of items, 
appropriate to assess the attairunent of his instructional 
goals. 



The Project is defining evaluation models appropt late fof 
assessment of goats in each of thf? classes of knowied^ and 
process. These modeK will t)e used to ^Ide both psycho- 
metricians and teachers m the development of criterion 
refereni»d test items appropriate for measuring each type of 
knowledge and ^ocess. Teachers us«ng the course goats 
during the period tfie items are betni' developed wtH be 
asked to supply copies of their periodic and final examina- 
tions to provide raw material for a compreh ensive set of test 
items. Teacher aids for test item deveto(»nent based on the 
dif lereni goal types are being prepared to insure the (H^atity 
of the Item bank As soon as theoretical formulations relat- 
ing to values, ^neralizations, and concepts are refined and 
insistent, similar work will begin in developing evaluation 
models and items for those classes of learning. This work 
should take two to five years to ccmiptete, depervding on 
resources. 

Upi^ completion of the vjo&, descrited in this article, 
a complete* dynamic, open system will have been create 
for goal-based learning and evaluation. Such a system will 
be a useful resource to ail those seeking to improve their 
urtderstarKiing of what should be learned, how it f^hould be 
learr^ed, and how evaluated. 



Forthcoming reports on speciafized tests . . . 
Care^- Maturity by John O. Crites 
College Placement Tests by T. Anne Cteary 
Affective Measures by Ralph W. Tyler 



f REPORTS AVAILABLE 

i Bdd( issues of Measui^nwtt in Education are 
I avaiiabie at 254 each in quantities of 25 or more 
; for a single is^e. 

Vol. 1, No. 1 Helping Teacffers Use Tests by 
Robert L. Thorndike 

No. 2 Interpreting Achiewment Profiles- 
Um and Wamir^ by Eric F. 
Gardner 

No. 3 Mastery Learning mid Mastmy Tast- 
ing by Samuel T. Mayo 

No. 4 On Reporting Test Results to Com- 
nwnity Groups by Alden W. Badai 
& Edwin P. Larsen 

VoL 2, No. 1 National Ass^snwnt Says by Frank 
B. Womer 

No. 2 The PLAN System for Individualiz- 
ing Education by John C. Flanagan 

No. 3 M^urement Aspects of Nrform'- 
an(x Contracting by Richard E. 
Schutz 

No. 4 The History of Gr^ing Prxtices by 
Louise Witmer Cureton 

Vol. 3, No. 1 Using YcHsr Achievement Tm Score 
Reports by Edwin Gary Joselyn & 
Jack C. M^ivin 

N^2 An Item Analysis Service for 
Teachers by Willard G. Warrington 

No. 3 On the Reliability of Rating of 
Essay Examinations by William E. 
Coffman 

No. 4 Criterion-Referenced Testing in the 
Cli^room by Peter W. Airasian and 
Geor^ F. Madaus 
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